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Abstract 

We provide a strategy to find in few elementary calculations the 
critical exponents of the overlaps for dilute spin glasses, in absence of 
external field. Such a strategy is based on the expansion of a suitably 
perturbed average of the overlaps, which is used in the formulation 
of the free energy as the difference between a cavity part and the 
derivative of the free energy itself, considered as a function of the 
connectivity of the model. We assume the validity of certain reason- 
able approximations, e.g. that higher powers of overlap monomials 
are of smaller magnitude near the critical point, of which we do not 
provide a rigorous proof. 



'King's College London, Department of Mathematics, Strand, London WC2R 2LS, 

United Kingdom, and Dipartimento di Fisica, Universita di Roma "La Sapienza" Piaz- 

zale Aldo Moro 2, 00185 Roma, Italy; <Adriano . BarraOromal . inf n. it> 
tiCTP, Strada Costicra 11, 34014 Trieste, Italy; <lde_saiic(8ictp . lt> 
■t Dipartimento di Fisica, Universita di Roma "La Sapienza" - Piazzalc Aldo Moro 2, 

00185 Roma, Italy; <f olliaglass .phys .uniromal . lt> 



1 



1 Introduction 

Dilute spin glasses are important because of two reasons at least. Despite 
their mean field nature, they share with finite-dimensional models the fact 
that each spin interact with a finite number of other spins. Secondly, they 
are mathematically equivalent to some random optimization problems. The 
stereotypical model of dilute spin glasses is the Viana-Bray model [S] , which 
is equivalent to the Random X-OR-SAT optimization problem in computer 
science, and the model we use as a guiding example here. In the original 
paper [5] the equilibrium of the model was studied, even in the presence of 
an external field, but the critical behavior was not investigated. In the case 
of fully connected Gaussian models, the critical exponents were computed 
in a recent mathematical study IJ. Here we use the techniques developed 
in [5 for finite connectivity spin glasses to extend the methodology of [1] 
to the case of dilute spin glasses. We compute the critical exponents of the 
overlaps among several replicas (whose distributions constitute the order 
parameter of the model [5j). 

2 Model, notations, previous results 

Given N points and families {i^, ju, A;^ } of i.i.d random variables uniformly 
distributed on these points, the (random) Hamiltonian of the Viana-Bray 
model is defined on Ising A^-spin configurations a — (cri, . . . , ctat) through 



where is a Poisson random variable with mean C, {J^ = ±1} are i.i.d. 
symmetric random variables and a > 1/2 is the connectivity. The expec- 
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tation with respect to all the {quenched) random variables defined so far 
will be denoted by E, while the Gibbs expectation at inverse temperature /? 
with respect to this Hamiltonian will be denoted by O, and depends clearly 
on a and /?. We also define (•) = EO(-). The pressure, i.e. minus /? times 
the free energy, is by definition 

Awia) = -^Eln^exp(-/3ifjv(o-,a)) . 

When we omit the dependence on N we mean to have taken the ther- 
modynamic limit. The quantities encoding the thermodynamic properties 
of the model are the overlaps, which are defined on several configurations 
(replicas) a^^\ . . . , cr^"^ by 

i=l 

When dealing with several replicas, the Gibbs measure is simply the prod- 
uct measure, with the same realization of the quenched variables, but the 
expectation E destroys the factorization. We define Pc as the inverse tem- 
perature such that 2Qtanh^ /3c = 1. 

We are going to need the cavity function given by 

ipN{a',a) = Elnr2exp/3 J'v'^k^ 

where the quenched variables appearing explicitly in this expression are 
independent copies of those in f2. When the perturbation ^^l"/' J'v^K 
added to the Hamiltonian, the corresponding Boltzmann factor will give 
place to Gibbs and quenched expectations denoted by fij(-), and the 
subindex t is simply omitted when t = 1. This perturbation encoded 
in tp, when a' = a, is equivalent to the addition of a new spin to the 
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system (which can be interpreted as a gauging or spin- flip variable). As 
a consequence [3] gauge (or simply spin-flip in our case) invariant overlap 
monomials are those such that each replica appears an even number of times 
in them, and are stochastically stable: their average does not depend on the 
perturbation in the thermodynamic limit. The other overlap monomials are 
not invariant nor stochastically stable (the two concepts are equivalent), 
but their perturbed average can be expressed in terms of a power series in 
i, with (i-independent) stochastically stable (or invariant) averaged overlap 
polynomials as coefficients, in the thermodynamic limit. This is done by 
an iterative use of the following proposition, proven in ^ . 

Proposition 1 Let $ be a function of s replicas. Then the following cavity 
streaming equation holds 

a 

a<b a<6<c 

+ -!^e^.^-'±±Ml±^ jew + ■■■}] (1) 

where to — fl'^^ai^^), — tanh/3. 

Consider for simplicity the case of $ = qi...2n- In the right hand side 
above, consisting of the product of two factors in which each term brings 
a new overlap multiplying $, there is only one spin-flip invariant overlap: 
q\...2n- But for the other terms we can use again the streaming equation, 
and each non-invariant overlap will be multiplied by a suitable overlap so 
that the number of replicas appearing an odd number of times decreases 
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(by two) . Notice though that each time we use the streaming equation the 
corresponding exponent of ol (eventuaUy taken equal to a) increase by one 
and so does the order of the monomial. Let us be more explicit in the case 
of interest, and we will see that we do not need any explicit calculation, we 
only need to observe that monomial of order three or higher are multiplied 
by or higher powers of t. 

3 The expansion 

In the case of $ = (712, 91234, • • the previous proposition yields, integrating 
back in dt once the thermodynamic limit is taken 

(912); = r'i(g22)-2r'2t2 (5,2^23931) +0(g') (2) 

(<Zi...2„); = r'0'"-'i(g?...2n)+i'O((z3) + ... (3) 

where r' = 2a'0^ and we neglected monomials with the products of at least 
four overlaps. As an example, we gave the explicit form of the monomial 
of order three for n = 2. 

These expansions will be used to expand in terms of averaged stable 
overlap monomials. 

If we take t —\ and let /3 be very close to /3c, we know [3] that we can 
replace ((712)' by ((712), ™ the left hand side of This provides a relation, 
valid at least sufficiently close to the critical temperature, between (912) 
and ((Zi2'Z23'?3i), as we neglect the higher order monomials in 

(^-1)('??2) =2((Zl2g23<Z3l) (4) 
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Notice incidentally that this relation is compatible with the well known 
fact [7] that the fluctuations of the rescaled overlap Nqf2 diverge only 
when T I (and not at higher temperatures), being N{qi2q23q3i) small 
(due to the central limit theorem) as it is the sum of N'^ bounded variables 
dived by N'^ instead of N^^'^. 

4 Orders of magnitude 

In the expansions of the previous section, we need to understand which 
terms are small near the critical point. We know that above the critical 
temperature all the overlaps are zero, and that those which are not zero 
by symmetry become non-zero below the critical temperature; therefore we 
assume that slightly below such a temperature the overlaps are very small. 
More precisely, we know that for instance 

is very small, and so is therefore fl^ (at-^ai^) . This means that for temper- 
atures sufficiently close to the critical one ^'^{ai^ai^) is negligible as com- 
pared to fl^^ai-^ai^). In other words (91234) is assumed to be of a smaller 
order of magnitude than ((712)- Furthermore, if qf2 is small qf2 has to be 
of an even smaller order of magnitude. In fact we reasonably assume that 
(912) — lEfi'^ ((Tij (Ti2 (7^3 (Ji^ ) , which is of order two in 17, is of a smaller order 
than (912), which is also of order two in f2. An explanation comes from the 
self-averaging discussed in [B], which tells us that ¥.fl{ai-^(7i^ai^ai^) is of the 
same order as EQ{ai-^ai^)fl{ai.^ai^), which is of order two in Q, and hence 
increasing the number of spins in the expectation is basically equivalent 
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to increasing the order in fi. This is actuaUy proven in a perturbed system 
[B] , but it is reasonable to assume that the consequences of self-averaging 
(not the self-averaging itself) on the orders of magnitude of the considered 
quantities is not lost when the perturbation is removed, and the monomials 
we have are the result of the streaming equation, in which the measure is 
perturbed. Consistently, ^ implies that near the critical point ((7i2'723'?3i) 
is smaller than {ql2), and the two critical exponents differ by one. All 
these observations lead to the following criterion. We define the degree of 
an averaged overlap monomial as the sum of the degrees of each overlap 
in it, where the degree of an overlap is its exponent times its number of 
replicas. For instance (91234912934) is of order 4x2 + 2x2 + 2x2 = 16. 
The definition we just gave coincides with the one that can be given in 
terms of fl expectations, provided one multiplies the exponent of each 
ri-expectation by the number of randomly chosen spins appearing in it. 
For example (91234912934) = ^i^'^{ai^<7i2<7i.^ai^)Q'^{ai^ai2crir^(Ji^) is of order 
2x4 + 2x4 = 16. Given an integer m, a monomial of order 2m + 2 will be 
considered negligible, near the critical point - where all overlaps are very 
small, with respect to a monomial of order 2m. 

5 The transition 

It is well known that all the overlaps are zero above the critical tempera- 
ture l//3c where the replica symmetric solution holds, and that below this 
temperature the overlap between two replicas fluctuates and its square be- 
come non-zero T . As pointed out in [5] , the use of the replica trick within 
a quadratic approximation can only provide the correct transition for the 
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overlap between two replicas, while overlaps of more replicas would seem to 
be zero down to lower temperatures before starting fluctuating. Moreover 
within that method no information about the critical exponents was found. 
Our method allows to gain information about the critical exponents of all 
overlap monomials. Let us start by showing that there is only one critical 
point for all overlap monomials. By convexity, we have 

so that all overlaps are non-zero whenever ((712) i^i below the critical 
temperature 1/Pc- As a further example, a slightly more accurate use of 
convexity yields immediately {(li2Zi) ^ (912934) — ('Ziz)^- This means that 
the critical exponents of (7^234 ^^'^ 9i2934 cannot be larger than twice the 
critical exponent of qi2, but cannot be smaller than this critical exponent 
itself either, as ((Z1234} < (912)- 

6 Critical exponents 

We will now relate the free energy to its derivative and to the cavity func- 
tion. The following theorem follows easily from the results of 5J, and here 
we only sketch the proof, based on standard convexity arguments. 

Theorem 1 In the thermodynamic limit, we have 

A{a) =ln.2 + ijj{a,a) ~aA'{a) 
for all values of a, [3, where A' is the derivative of A. 
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Sketched Proof. It was proven in ^ that 

A{a) = lim[Elnr!( ^ exp(/?^ J>fc„CT^v+i))- 

ajsf + l i'=l 

E\nfl{exp-(3iH'^ia/N)))] (5) 

where the quenched variables in H' are independent of those in Q, just hke 
for the first term in the right hand side. The second term in the right hand 
side is easy to compute, at least in principle and it is the derivative of 
A multiplied by a, because 

E\iin{exp-P{H'j^{a/N))) = NA{a{l + 1/N) ^ NA{a) . 

This leads to the result to prove, as the gauge invariance of fl allows to 
take out the sum over crj^^i as In 2, and therefore the first term in the right 
hand side of ^ is precisely ip. □ 
It is easy to see that [5] 

aiViv(a',a) = 2^— (l-(gi...2„)') , (6) 

n 

^'(") = E^(l-(9?...2„))- (7) 

n 

From the theorem we have then 

A' {a) = diip{a, a) + d2ip{a, a) - A' (a) - aA"{a) . 

But we know 3J that near the critical point saturation {q2n)' ~> ('zin) occurs 
in the thermodynamic limit, so that di'>p{a,a) —* A' (a) and therefore we 
have just proven the next 

Proposition 2 In the thermodynamic limit 

d2^ia, a) -aA" (a) ^0 . (8) 
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Notice that if in the statement of Theorem [T] we assumed saturation 
{<li---2n)'t ~* {li---2n) just for t ~ 1 but for all t (once ip{ta, a) is written 
using ^ as the integral of its derivative with respect to i), we would obtain 
ip = 2A' and 



which, as the initial condition is easily checked to be ^'(0) — In cosh /3, 
gives the well known replica symmetric solution A(a) = ln2 + a In cosh /3. 
This means that stability and saturation of the overlaps are equivalent to 
replica symmetry. 

Now let us analyze We consider ip{a',a) as the integral of its 

derivative with respect to its first argument. The derivative, given in ([6]), 
contains the perturbed averaged overlaps, which we expand using ([2|)-f3|) 
etc.. In this expansions the variable a' appears only explicitly in front of 
the averaged overlap monomials, which do not depend on a', they only 
depend on a. Therefore we can perform explicitly the integration of these 
simple power series in a'. The dependence on a of ipla'^a) is hence only 
in the averaged overlap monomials, and the same holds for A' (a), because 
of (O. Therefore the derivatives of ip{a' , a) and of A' (a) with respect to a 
in ([5]) involve only the averaged overlap monomials. In other words if we 
define A{a' , a) = ln2 + ^/'(a', a) — a' A' (a), so that A{a) — A{a, a) thanks 
to Theorem[l] equation ([5]) amounts to say that d2A{a,a) = 0. But since 
the second argument appears only in the averaged overlap monomials, we 
can consider A{a) — A{a,a) = A{a,pi{a),p2{a), . . .) a function of the 
averaged overlap monomials, here called pi{a) , p2{a) , . . ., such that 



A{a) = a^'(a) +ln2 , 
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We can now use ([l])-® etc. to have an explicit expansion of A{a) and deal 
with the differential equation The result is easy to obtain and reads 

3 

A{a) = ln2 + ^ - ^(r - l){ql^) + ^{q^^q^^qy,) + 0{q^) 

+ - ^{re^ i)(g?234) - ^(91234912934) + 0(9')) 

+ 0{d^). (10) 

Notice that this expansion extends the one found in [5] . As a first approx- 
imation we may consider 

3 

A{a) ^ ln2 + ^ - ^(r - l){ql^) + ^(912923913) 



and © becomes 



because 



\r l) ^^^!^) J 1 C;(gi2g2393l) _ Q ^^^^ 

4 a 3 a 



TT - 7(--l)--7(--l) 



a(9?2) 4^ ' 4 

A t3 1 



3(912923931) 3 3 

But now the use of Q in pTjl offers 

4^ 3 2 da 

from which, after a couple of elementary steps 

This equation is as accurate as close the temperature is to the critical one, 
and the solution is easy to find: 

(9?2) = (r-l)^ 
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describing the critical behavior of the overlap slightly below the critical 
temperature. The critical exponent is hence two. 

Notice that ^ imply that (912923931) is zero above the temperature 
1//32 and positive slightly below. Moreover, ^ gives the critical exponent 
for (912923931): three. 

From our analysis in the previous sections, we conclude that the critical 
exponent of 9^234 is strictly larger than three, but no larger than four. The 
criterion explained in the section on the order of magnitudes, together with 
|4]and the critical exponent of 9^21 provides a relation between the degree of 
an overlap monomial and its critical exponent: degree 2m corresponds to 
critical exponent m. So for instance the critical exponent of 9i...2„, which 
is of order 4n, is 2n. 

In the infinite connectivity limit we recover the all the critical exponents 
for the fully connected Gaussian SK model [IJ. 

Remark. If we extended the use of (91. ..2n)' (9i- -2ri) to lower tem- 
peratures, such that 2a6'^" = T2n ^ 1, we would obtain for 9i...2„, for all 
n, the same identical differential equation we got for 9^2- We would then 
get the same approximated behavior one gets using the replica method in 
a quadratic approximation [9 : 9|„ would be zero above the temperature 
such that T2n — 1, then it starts fluctuating, with critical exponent two. In 
this sense the replica method with quadratic approximation is equivalent 
to extending stochastic stability below the critical point. 
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7 Summary and conclusions 

Our strategy requiree the expansion of the averaged overlaps in powers 
of a perturbing parameter with stochasticaUy stable overlap monomials as 
coefficient (similarly to the expansion exhibited in 2J for Gaussian models) . 
This allowed to write the free energy in terms of overlap fluctuations and 
to discover that it does not depend on a certain family of these monomials. 
As a consequence, we obtained a differential equation whose solution, once 
all small terms are neglected, gave the critical behavior of the overlaps. 

Our method is ultimately based on stochastic stability, but such a sta- 
bility is proven or at least believed to hold in several contexts, therefore 
generalizations of our method to finite dimensional spin glasses, to the trav- 
eling salesman problem, to the K-SAT problem, to neural networks and to 
other cases are not to be excluded and are being studied. We plan on 
reporting soon on these topics [4]. 
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